Clothes and accessories fitting method, display system and computer-readable recording medium thereof

ABSTRACT

A clothes and accessories fitting method, a display system and a computer-readable recording medium thereof are provided, where the method is applicable to a display system having an image capturing device and a screen and includes the following steps. Images of a user wearing a first apparel appearing in front of the screen are continuously or intermittently captured by using the image capturing device. When a first image of the user in a particular pose is determined to be included in the images, the first image is shot by using the image capturing device. A foreground region and a background region in the first image are segmented, and the background region is processed to generate a processed background region. A first preview image is generated according to the foreground region and the processed background region and displayed on the screen.

CROSS-REFERENCE TO RELATED APPLICATION

This application claims the priority benefit of Taiwan applicationserial no. 107116672, filed on May 16, 2018. The entirety of theabove-mentioned patent application is hereby incorporated by referenceherein and made a part of this specification.

TECHNICAL FIELD

The disclosure relates to a display technology, and more particularly,to a clothes and accessories fitting method, a display system and acomputer-readable recording medium thereof.

BACKGROUND

While a consumer is buying clothes or accessories at a physical store,he/she would normally need to try them on repeatedly to select the mostsatisfying pieces. However, the consumer may not only feeltime-consuming and tedious, but may also occupy a fitting room for aconsiderable amount of time. One prior art has proposed a virtualclothes fitting product which captures an image of the user by using acamera and adds virtual clothes onto the captured image. The image ofthe virtual clothes under such simulated environment may not match withthe figure of the user and may look unreal. Further, after such repeatedfitting, with the lack of functions for the user to compare visualdifferences among multiple sets of clothes at the same time, users canonly select more appropriate pieces by memory.

As information technology has been incorporated into many aspects in ourdaily life, a significant trend has been towards the development ofsmart products. Hence, to incorporate the existing products intophysical stores for interactive fitting and comparison has become a wayto optimize life experiences for the consumer.

SUMMARY OF THE DISCLOSURE

The disclosure provides a clothes and accessories fitting method, adisplay system and a computer-readable recording medium thereof, whichare capable of substantially optimizing users' shopping experience inthe clothes and accessories fitting process for the user.

In an embodiment of the disclosure, the method is applicable to adisplay system having an image capturing device and a screen, andincludes the following steps. Images of a user wearing a first apparelappearing in front of the screen are continuously or intermittentlycaptured by using the image capturing device. When a first image of theuser in a particular pose is determined to be included in the images,the first image is shot by using the image capturing device. Aforeground region and a background region in the first image aresegmented, and the background region is processed to generate aprocessed background region. A first preview image is generatedaccording to the foreground region and the processed background regionand displayed on the screen.

In an embodiment of the disclosure, the display system includes an imagecapturing device, a screen, a data storage device and a processor. Theprocessor is coupled to the image capturing device, the screen, and thedata storage device. The image capturing device is configured to captureimages, and the screen is configured to display images. A capturingdirection of the image capturing device is the same as a displaydirection of the screen. The data storage device is configured to storedata. The processor is configured to execute steps of: capturing aplurality of images of a user wearing a first apparel appearing in frontof the screen continuously or intermittently by using the imagecapturing device; when a first image of the user in a particular pose isdetermined to be included in the images, shooting the first image byusing the image capturing device; segmenting a foreground region and abackground region in the first image, and processing the backgroundregion to generate a processed background region; and generating a firstpreview image according to the foreground region and the processedbackground region, and displaying the preview image on the screen.

In an embodiment of the disclosure, the computer-readable recordingmedium is configured to execute each step in the clothes and accessoriesfitting method described above.

To make the above features and advantages of the disclosure morecomprehensible, several embodiments accompanied with drawings aredescribed in detail as follows.

BRIEF DESCRIPTION OF THE DRAWINGS

The accompanying drawings are included to provide a furtherunderstanding of the disclosure, and are incorporated in and constitutea part of this specification. The drawings illustrate embodiments of thedisclosure and, together with the description, serve to explain theprinciples of the disclosure.

FIG. 1 is a block diagram illustrating a display system according to anembodiment of the disclosure.

FIG. 2 is a flowchart illustrating a clothes and accessories fittingmethod according to an embodiment of the disclosure.

FIG. 3 is a flowchart illustrating a clothes and accessories fittingmethod according to another embodiment of the disclosure.

FIG. 4 is a schematic diagram illustrating related information of anapparel according to an embodiment of the disclosure.

FIG. 5 is a schematic diagram illustrating images corresponding todifferent poses according to an embodiment of the disclosure.

FIG. 6 is a flowchart illustrating an image processing according anembodiment of the disclosure.

FIG. 7 is a schematic diagram illustrating a first image according to anembodiment of the disclosure.

FIG. 8 is a schematic diagram illustrating settings for a depth blockaccording to an embodiment of the disclosure.

FIG. 9A to FIG. 9B are schematic diagrams illustrating a foregroundextension correction according to an embodiment of the disclosure.

FIG. 10 is a schematic diagram illustrating designated preview imagesaccording to an embodiment of the disclosure.

DESCRIPTION OF THE EMBODIMENTS

Some embodiments of the disclosure will now be described more fullyhereinafter with reference to the accompanying drawings, in which some,but not all embodiments of the application are shown. Indeed, variousembodiments of the disclosure may be embodied in many different formsand should not be construed as limited to the embodiments set forthherein; rather, these embodiments are provided so that this disclosurewill satisfy applicable legal requirements. Like reference numeralsrefer to like elements throughout. The embodiments are merely a part ofthe disclosure rather than disclosing all possible embodiments of thedisclosure. More specifically, these embodiments are simply examples ofa method, a system and a computer-readable recording medium recited inclaims of the disclosure.

FIG. 1 is a block diagram illustrating a display system according to anembodiment of the disclosure. It should, however, be noted that this ismerely an illustrative example and the disclosure is not limited in thisregard. All components of the display system and their configurationsare first introduced in FIG. 1. The functionalities of the componentsare disclosed in more detail in conjunction with FIG. 2.

With reference to FIG. 1, a display system 100 includes an imagecapturing device 110, a screen 120, a data storage device 130 and aprocessor 140. Among them, the processor 140 is coupled to the imagecapturing device 110, the screen 120 and the data storage device 130,and the image capturing device 110 is disposed on the same side as thescreen 120. In this embodiment, the display system 100 may be anall-in-one display formed by integrating the image capturing device 110,the screen 120, the data storage device 130 and the processor 140together. In another embodiment, the display system 100 may be acomputer system having the screen 120, the data storage device 130 andthe processor 140. In this case, the image capturing device 110 isexternally connected to the computer system, and a capturing directionof the image capturing device 110 is the same as a display direction ofthe screen 120 (e.g., both facing forward). In other embodiments, thedisplay system 100 may also be an electronic device having imagecapturing functions and display functions, such as a large tabletcomputer. The disclosure is not limited in this regard.

The image capturing device 110 is configured to capture images appearingin front of the screen 120 and includes a camera lens having a lens andphotosensitive elements. The photosensitive elements are configured tosense an intensity of light ray entering the lens in order to generatean image. The photosensitive elements may be, for example, chargecoupled device (CCD) elements, complementary metal-oxide semiconductor(CMOS) elements or the like, which are not particularly limited in thedisclosure.

The screen 120 is configured to display images. In this embodiment, thescreen 120 may be a liquid crystal display (LCD), a light emitting diode(LED) display, an organic light emitting diode (OLED) display ordisplays of other types.

The data storage device 130 is configured to store data includingimages, programming codes, setting values or the like, and may be, forexample, a stationary or mobile device in any form such as a randomaccess memory (RAM), a read-only memory (ROM), a flash memory, a harddrive or other similar devices, integrated circuits or a combination ofthe above.

The processor 140 is configured to control operations between thecomponents in the display system 100, and may be, for example, a centralprocessing unit (CPU), or other programmable devices for general purposeor special purpose such as a microprocessor, a digital signal processor(DSP), a programmable controller, an application specific integratedcircuit (ASIC), a programmable logic device (PLD) or other similardevices or a combination of above-mentioned devices.

Embodiments are provided below with reference to each element in thedisplay system 100 of FIG. 1, and served to describe detailed steps in adisplay method executed by the display system 100.

FIG. 2 is a flowchart illustrating a clothes and accessories fittingmethod according to an embodiment of the disclosure, and the flow ofFIG. 2 may be realized by the display system 100.

Referring to FIG. 1 in conjunction with FIG. 2, first of all, theprocessor 140 of the display system 100 captures a plurality of imagesin front of the screen 120 continuously or intermittently by using theimage capturing device 110 (step S202). Here, the processor 140 maystart capturing live images by using the image capturing device 110 whenthe display system 100 is activated or at a particular time (e.g., anopening time of the store).

Next, the processor 140 determines whether a first image of the user ina particular pose is included in the images captured by the imagecapturing device 110 (step S204). If not, the process returns to stepS202 so the images appearing in front of the screen 120 can becontinuously or intermittently captured. If yes, when determining thatthe first image of the user in the particular pose is captured by theimage capturing device 110, the processor 140 shoots the first image byusing the image capturing device 110 (step S206). Here, it is assumedthat the user in the first image is wearing the first apparel. Theprocessor 140 may determine whether a pose of the user in the imagesmatches the particular pose by using a skeleton detection algorithm,which may be realized by, for example, directing adopting OpenCVcomputer visual database or a skeleton detection function provided byKinect software development tools. The so-called pose may refer to poseand orientation of the body with respect to the screen or the imagecapture device 110 (e.g., turning 30 degrees with respect to thescreen), and the particular pose may be a pose predefined by theprocessor 140 (e.g., turning 30 degrees, 45 degrees, 90 degrees) andused to facilitate the user to watch and compare wearing effects indifferent poses.

Next, the processor 140 segments a foreground region and a backgroundregion in the first image (step S208), processes the background regionto generate a processed background region (step S210), and generates afirst preview image according to the foreground region and the processedbackground region (step S212). Here, the processor 140 may segment theforeground region and the background region in the first image by usinga foreground-background segmentation. The foreground region refers to aregion where the user is located, and the background region is a regionoutside the foreground region. Next, the processor 140 may perform blurprocess or replacement processing on the background region. In this way,the processed background region may further highlight the user and thefirst apparel being worn in the foreground regions so the first previewimage can have a better visual effect. Afterwards, the processor 140displays the first preview image on the screen 120 (step S214) for userviewing.

For better comprehension, the actual application method and details ofFIG. 2 are described more specifically below with reference to FIG. 3,which is a functional flowchart illustrating a clothes and accessoriesfitting method according to another embodiment of the disclosure. Theflow in the method of FIG. 3 may also be realized by the display system100.

Referring to FIG. 1 in conjunction with FIG. 3, after the display system100 is activated, the processor 140 presets the display system 100 toenter a mirror mode MM so as to allow live images captured by the imagecapturing device 110 to be displayed on the screen 120 in real time. Inother words, in the mirror mode MM, because the images presented on thescreen 120 provides a mirror-reflection effect, the display system 100can provide a dressing mirror function.

On the other hand, in the mirror mode MM, the processor 140simultaneously determines whether a potential user is included (i.e.,whether any human body is detected) in the live images captured by theimage capturing device 110 by using, for example, a human detectionalgorithm. If the processor 140 determines that the potential user isnot included in the live images, the processor 140 would not change themode of the display system 100. In other words, the display system 100would stay in the mirror mode MM. If the processor 140 determines thatthe potential user is included in the live images, the processor 140would set the display system 100 to enter a video mode VM.

In the video mode VM, in addition to continuously or intermittentlydisplaying the live images captured by the image capturing device 110 onthe screen 120 in real time, the processor 140 would further activate avideo function so as to store the live images in the data storage device130 in a video format. In addition, in the video mode VM, the processor140 would continuously or intermittently detect whether the potentialuser is included in the live images (i.e., whether the potential usercontinuously stays or leaves). When the processor 140 determines thatthe potential user in the live images leaves, the potential user maysimply be a clerk or a customer passing by the image capturing device110 instead of the user who wishes to use the display system 100. Inthis case, the processor 140 would set the display system 100 to leavethe video mode VM, return to the mirror mode MM, and delete the recordedvideo.

In this embodiment, when detecting that the potential user logs into thedisplay system 100 by executing a login procedure LGN through an inputdevice (not illustrated), the processor 140 would determine that thispotential user is indeed an authorized user of the display system 100.Next, the processor 140 would set the display system 100 to leave thevideo mode VM, store the recorded video in a database db, and allow theuser to select one of a try-on mode TM, a lookbook mode LBM and anidentification code mode CM to be entered through the input device.Here, the database db may be stored in the data storage device 130 or acloud storage system. The disclosure is not limited in this regard.According to login data of the user, the processor 140 may store thevideo to a dedicated space of the user in the database db. The processor140 can allow the user to watch the video recording a fitting process sothe user can understand clothing features better.

It should be noted that, in another embodiment, the login procedure LGNmay also be omitted. For example, when determining that the potentialuser intends to use the display system 100 (e.g., when a time that thepotential user stays in front of the screen 120 is greater than a timethreshold, or when the potential user or anyone presses down aparticular button on the input device or touches a touch screen, or thepotential user makes a specific gesture in front of the image capturingdevice 110), the processor 140 would directly determine that thispotential user is indeed the authorized user of the display system 100.Similarly, the processor 140 would set the display system 100 to leavethe video mode VM, store the recorded video in the database db, andallow the user to select one of the try-on mode TM, the lookbook modeLBM and the identification code mode CM to be entered through the inputdevice.

In the identification code mode CM, the display system 100 can allow theuser to search for related information of an apparel. The user can movean identification code on the apparel towards the image capturing device110 for scanning so as to obtain the related information of suchapparel. Here, the identification code on the apparel may be a linearbarcode (e.g., barcode), a 2D barcode (e.g., QR code), or a combinationof other numbers, texts, symbols, and the like. From anotherperspective, when determining that an identification code image havingthe identification code is captured by the image capturing device 110,the processor 140 would set the display system 100 to enter theidentification code mode CM, and display the related information of theapparel on the screen 120 for user reference according to thatidentification code. In addition to the related information of theapparel rapidly provided for the user, the identification code mode CMmay further allow the processor 140 to directly obtain the apparelcurrently held or worn by the user so as to save the trouble ofidentifying the apparel from the images. Further, the processor 140 alsostores the related information of the apparel searched by the user inthe database db to facilitate subsequent applications.

FIG. 4 is a schematic diagram illustrating related information of anapparel according to an embodiment of the disclosure. In view of FIG. 4with reference to FIG. 1 and FIG. 3, when detecting an identificationcode image of an apparel C, the processor 140 would display an image ofa model M wearing the apparel C and related information 404 of theapparel C (e.g., product name, price, size, color shade, material andthe like) by an interface 400. In this embodiment, the processor 140 canfurther allow the user to select on options for reusing theidentification code mode 401, leaving the scan mode 402 and directlyentering the try-on mode 403 through the interface 400. When the userselects the option for reusing the identification code mode 401, theprocessor 140 would close the interface 400, and set the display system100 to re-enter the identification code mode CM for allowing the user tosearch for related information of other apparels. When the user selectsthe option for leaving scan mode 402, the processor 140 would close theinterface 400, and allow the user to re-select one of the try-on modeTM, the lookbook mode LBM and the identification code mode CM. When theuser selects the option for directly entering try-on mode 403, theprocessor 140 would close the interface 400, and set the display system100 to enter the try-on mode TM. In addition, the processor 140 wouldalso store all the related information of the apparels searched by theuser together in the database db. Incidentally, the display system 100may also provide only general functions of the identification code modeCM when the user is not logged in, so that anyone can search for therelated information of interested apparels at any time.

Referring back to FIG. 3, in the try-on mode TM, the processor 140 maydetermine whether the pose of the user in the images matches theparticular pose, and accordingly determine whether to drive the imagecapturing device 110 for shooting. Here, the particular pose may be apose predefined by the processor 140 or a representative pose, such asfront, back, left and right of the body facing in front of the screen120 (which are respectively referred as “forward pose”, “backward pose”,“leftward pose” and “rightward pose” hereinafter).

In the schematic diagram of images corresponding to difference posesillustrated in FIG. 5 according to an embodiment of the disclosure, forexample, an image 510, an image 520, an image 530 and an image 540 areimages of a user U wearing the apparel C which are shot in accordancewith “forward pose”, “backward pose”, “leftward pose” and “rightwardpose”, respectively. However, in other embodiments, the particular posecapable of driving the image capturing device 110 for shooting may befurther defined in response to store or user needs so as to provide thewearing effects in more angles and orientations for user reference.

Assume that the user is wearing the first apparel. Afterimages ofdifferent poses are shot by the image capturing device 110, theprocessor 140 would perform an image processing P on these images. Theprocessing of an image having “forward pose” (hereinafter, referred toas the “first image”) among these images is described below withreference to FIG. 6, which is the flowchart of illustrating the imageprocessing according to an embodiment, in conjunction with the imageschematic diagram, and images corresponding to other poses can bededuced in a same fashion.

With reference to FIG. 6, after obtaining a first image Img, theprocessor 140 executes procedures including a segmenting boundarydefinition stage S1, a foreground processing stage S2 and a backgroundprocessing stage S3.

In the segmenting boundary definition stage S1, the processor 140 woulddefine a boundary of a foreground segmented region. First of all, theprocessor 140 performs facial detection on the first age to define afacial region of the user (step S611). Here, the processor 140 maydefine the facial region by using a face detection algorithm, such asHaar-like feature extraction. Taking the schematic diagram of a firstimage 700 illustrated in FIG. 7 according to an embodiment of thedisclosure as an example, the facial region is a region encompassed by aframe 710.

Next, the processor 140 defines a head region of the user according tothe facial region (step S612). Here, the processor 140 may expand thefacial region to twice of its original size to generate the head region.Here, the expanding factor of the facial region is an empirical value,and yet the disclosure is not limited thereto. In the example of FIG. 7,the head region is a region encompassed by a frame 720.

Next, the processor 140 defines a height of the user according to thefacial region (step S613). For instance, the processor 140 may estimatethe height of the user in the first image 700 with the top of the headregion as an upper edge and the bottom of the first image as a loweredge. Taking FIG. 7 as an example, the height of the user in the firstimage 700 is Y. In this embodiment, to avoid estimation errors, theprocessor 140 defines an upper edge of a segmenting boundary (step S614)at the height of the user in the first image increased by, for example,0.1Y, so as to obtain a height of the segmenting boundary. Here, theincrement factor of 0.1 is also an empirical value. In the example ofFIG. 7, the upper edge of the segmenting boundary is UE.

Next, the processor 140 obtains a segmenting center axis by a center ofthe facial region (step S615) and obtains a left edge and a right edgeof the segmenting boundary according to a preset ratio and the height ofsegmenting boundary (step S616). Here, the preset ratio may be anoriginal ratio of the first image (e.g., 10:16) or a ratio defined byother developers. In the example of FIG. 7, the segmenting center axisis CL, and the left edge and the right edge of the segmenting boundaryare LE and RE respectively. Incidentally, in this embodiment, the loweredge of the segmenting boundary is the bottom of the first image (e.g.,DE in FIG. 7).

After defining the segmenting boundary, the processor 140 enters theforeground processing stage S2. Here, it should be noted that, theforeground processing stage S2 is mainly realized with use of depthinformation corresponding to the first image. In order to detect thedepth information in front of the screen 120, the display system 100 ofthe present embodiment may be additionally disposed with depth sensors(not illustrated) at the same side as the screen 120, and said depthsensors may be an active depth sensor and a passive depth sensor. Theactive depth sensor may calculate the depth information in front of thescreen 120 by actively emitting signals including light source,ultrasonic, laser. On the other hand, the passive depth sensor may be,for example, another image capturing device which cooperates with theimage capturing device 110 to capture two images in front of the screen120 from different viewing angles at the same time, so as to calculatefor the depth information in front of the screen 120 by usingdisparities between the two images.

In the foreground processing stage S2, the processor 140 obtains a depthimage corresponding to the first image (step S621) and performsbinarization on the depth image (step S622) to accordingly generate aplurality of foreground pixels. Here, the foreground pixels are pixelswith a pixel value of 255 (white color) after being processed bybinarization.

Next, the processor 140 performs erosion (step S623), dilation (stepS624) and blur processing (step S625) on the foreground pixels togenerate foreground depth pixels. It should be apparent to those skilledin the art that, erosion can eliminate fragmentary foreground pixels,dilation can recover eroded edges, and blur processing can smooth outunsmooth edges caused by erosion and dilation to obtain integralforeground depth pixels with smooth edges.

In general, the foreground depth pixels obtained through aforesaid stepswould often show an edge shrinkage, which refers to a situation wherethe eroded edges cannot be recovered even after dilation. Accordingly,the processor 140 further performs a foreground extension processing onthe foreground depth pixels according to pixel values of the first image(step S626), so as to set a background depth pixel neighboring to andhaving a similar pixel value to the foreground depth pixels as one ofthe foreground depth pixels.

Taking the schematic diagram illustrating settings for a depth block inFIG. 8 as an example, it is assumed that the background depth pixels areb1 to b5 and the foreground depth pixels are f1 to f4 in a depth pixelblock 800. The processor 140 may first perform a pixel value comparisonon the background depth pixel neighboring to the foreground depth pixelsf1 to f4. For example, the background depth pixel b4 is first comparedwith values (e.g., averages) of three color channels RGB correspondingto the foreground depth pixels f2 to f3. For instance, it is assumedthat RGB values corresponding to the background depth pixel b4 areR_(b4), G_(b4) and B_(b4), and averages of RGB values corresponding tothe foreground depth pixels f2 to f3 are R_(avg), G_(avg) and B_(avg).The processor 140 would compare R_(b4) with R_(avg), G_(b4) withG_(avg), and B_(b4) with B_(avg). If the differences of the three colorchannels RGB are all less than a preset pixel threshold (e.g., 10), theprocessor 140 would determine that the background depth pixel b4 issimilar to the foreground depth pixels f2 to f3, and change thebackground depth pixel b4 to be a foreground depth pixel f5 so as togenerate an updated depth pixel block 800′. Then, the processor 140would compare background depth pixel b5 with the RGB valuescorresponding to the foreground depth pixels f1 to f5 according to themethod above. If the differences between the background depth b5 and theforeground depth pixels f1 tot f5 are overly large, the processor 140would not change the setting for the background depth pixel b5.

As a side note, the foreground extension processing often leads to afloor extension issue, i.e., a continuous block composed of the floorbeing mistakenly determined as the foreground. Accordingly, in thisembodiment, the processor 140 may solve such issue according to FIG. 9Ato FIG. 9B, which are schematic diagrams illustrating a foregroundextension correction according to an embodiment of the disclosure.

With reference to FIG. 9A, after obtaining a first image 900, theprocessor 140 would create a depth-distance relationship table DH-Zaccording to a midline FC of a depth image as shown in FIG. 9B. Becausethe field for shooting the first image is fixed, the processor 140 canobtain a possible location range of the user U, i.e., at a locationbetween a line d_(far) and a line d_(near), according to an optimalshooting distance. Here, the shooting range may be, for example, between1.6 m and 2.6 m with respect to the image capturing device 110. Next,the processor 140 can obtain a depth information range R between theline d_(far) and the line d_(near) according to the depth (DH)-distance(Z) relationship table DH-Z, and filter out those originally determinedas the foreground depth pixels but having the depth information greaterthan the depth information range.

Referring back to FIG. 6, after obtaining the foreground depth pixels,the processor 140 defines pixels corresponding to the foreground depthpixels (hereinafter, also referred to as “foreground plane pixels”) inthe foreground segmented region in the first image to be set as aforeground region (step S627). On the other hand, the processor 140 setsa region outside the foreground region in the first image as abackground region and enters the background processing stage S3.

In this embodiment, the processor 140 allows the user to choose one fromtwo background processing methods—a background blur processing (stepS631) or a background replacement processing (step S632). Afterwards,the processor 140 would generate a first preview image Img′corresponding to the first apparel according to the foreground regionand the processed background region so as to finish the flow forprocessing the first image Img. For the background blur processing, theprocessor 140 may perform processing like Gaussian blur on thebackground region so the processed background region can be diluted tothereby highlight a main body of the foreground region. For thebackground replacement processing, the processor 140 may first determinewhether the related information of the first apparel is stored in thedatabase db (i.e., the user has already scanned the identification codeof the first apparel by using the image capturing device 110). Whendetermining that the related information of the first apparel is notstored in the database db, the processor 140 would replace an originalbackground region by a preset background as the processed backgroundregion. Here, the preset background may be a background preset by thesystem, such as a single color background. When determining that therelated information of the first apparel is stored in the database db,the processor 140 may obtain a main color shade of the first apparelfrom the related information of the first apparel such that acontrasting color of the main color shade may be obtained from aconventional color wheel and used as the single color background (or thecontrasting color may be used to obtain a background with thecontrasting color as a main color) to also highlight the main body ofthe foreground region.

Referring back to FIG. 3, after processing the preview imagescorresponding to the different poses, the processor 140 stores all thepreview images corresponding to the first apparel in the database db andprovided as a preview PV for the user. It should be noted that, theprocessor 140 may display the preview images one by one on the screen120 as the preview for the user each time after one preview image isgenerated, or may display all the preview images on the screen 120 asthe preview for the user after all the preview images are generated.Next, when the user chooses to shoot more images or re-shoot images, theprocessor 140 would set the display system 100 to return to the try-onmode TM. When the user chooses to leave the try-on mode TM or theprocessor 140 determines that enough preview images are taken, theprocessor 140 would set the display system 100 to enter the lookbookmode LBM.

In the lookbook mode LBM, the processor 140 may display all the previewimages of the first apparel on the screen 120 at the same time or one ata time, and the user can enlarge a particular image or a partial areathereof. For instance, the processor 140 may display an interactivecursor or a rectangle frame on the screen 120 for the user to perform aselection operation. When the selection operation performed by the useron a particular location on the screen 120 is detected (i.e., when thecursor or the rectangle frame is detected at the specific location onthe screen) by the processor 140, the processor 140 may partiallyenlarge the image area corresponding to the particular location anddisplay the enlarged image area beside the particular location.

The method for generating the first preview image after the imageprocessing on the captured first image of the user wearing the firstapparel has been described as the above. Similarly, the same method mayalso be applied when the user changes to a second apparel, and so on andso forth. In this way, when the preview images of the user wearingdifferent apparels are stored in the database db, in the lookbook modeLBM, the display system 100 can provide the preview images of the userwearing different apparels in the same pose to be watched by the user.For instance, the processor 140 may detect the selection operationperformed by the user on one of the poses, and display all the previewimages corresponding to the pose designated by the user (collectivelyreferred to as a “designated preview image”) on the screen 120.

Specifically, FIG. 10 is a schematic diagram illustrating designatedpreview images according to an embodiment of the disclosure. It isassumed that, when detecting the selection operation performed by theuser on “forward pose”, the processor 140 would display, at the sametime on the screen 120, processed designated preview images 1001 to 1004of the user U wearing first to fourth apparels C1 to C4 in “forwardpose” shot in front of the image capturing device 110 and the screen120, so the user can compare visual differences among the first tofourth apparels C1 to C4 intuitively.

As a side note, in this embodiment, the processor 140 may set up astorage time limit for the settings in the database db. In other words,when determining that a time length of one preview image stored in thedatabase db exceeds a time threshold (e.g., one season), the processor140 would delete that preview image.

The disclosure further provides a non-transitory computer-readablerecording medium. This computer-readable recording medium can store aplurality of program code segments (e.g., creating an organizationdiagram program section, approving a list program section, setting aprogram section, and deploying a program section). The steps in theclothes and accessories fitting method above may be completed afterthese program code segments are loaded and executed by the processor 140of the display system 100.

In summary, with the clothes and accessories fitting method, the displaysystem and the computer-readable recording medium thereof proposed bythe disclosure, in addition to providing a normal dressing mirrorfunction for displaying clothing images of the user in real time, thevisual effects of the clothing images may be further enhanced throughimage processing. Moreover, the disclosure further provides the imagesof the user wearing different apparels being shot to be viewed by theuser along with the related information of the apparels for userreference. As a result, the number of times that the user repeatedlytries on a same apparel as well as his/her shopping time may be reduced,and shopping experiences at physical stores for the user may be therebyoptimized.

Although the present disclosure has been described with reference to theabove embodiments, it will be apparent to one of ordinary skill in theart that modifications to the described embodiments may be made withoutdeparting from the spirit of the disclosure. Accordingly, the scope ofthe disclosure will be defined by the attached claims and not by theabove detailed descriptions.

It will be apparent to those skilled in the art that variousmodifications and variations can be made to the structure of the presentdisclosure without departing from the scope or spirit of the disclosure.In view of the foregoing, it is intended that the present disclosurecover modifications and variations of this disclosure provided they fallwithin the scope of the following claims and their equivalents.

What is claimed is:
 1. A clothes and accessories fitting method,applicable to a display system having an image capturing device and ascreen, comprising: capturing a plurality of images of a user wearing afirst apparel appearing in front of the screen continuously orintermittently by using the image capturing device; in response that afirst image of the user in a particular pose is determined to beincluded in the images, shooting the first image by using the imagecapturing device; segmenting a foreground region and a background regionin the first image, and processing the background region to generate aprocessed background region; and generating a first preview imageaccording to the foreground region and the processed background region,and displaying the preview image on the screen.
 2. The method accordingto claim 1, wherein during the step of capturing the images of the userwearing the first apparel appearing in front of the screen continuouslyor intermittently by using the image capturing device, the methodfurther comprises: presetting the display system to enter a mirror modeso as to allow the images captured by the image capturing device to bedisplayed on the screen in real time.
 3. The method according to claim2, wherein during the step of capturing the images of the user wearingthe first apparel appearing in front of the screen continuously orintermittently by using the image capturing device, the method furthercomprises: determining whether there exists a potential user in theimages; and in response that the potential user is determined to beexisted in the images, setting the display system to enter a video modeso as to allow the images captured by the image capturing device to bedisplayed on the screen and recording the images to generate a recordedvideo.
 4. The method according to claim 3 further comprising: inresponse that the potential user in the images is determined to leave,setting the display system to leave the video mode and to return to themirror mode and deleting the recorded video.
 5. The method according toclaim 3 further comprising: in response that the potential user isdetermined to be an authorized user of the display system, setting thedisplay system to leave the video mode and storing the recorded video ina database.
 6. The method according to claim 1, wherein before the firstimage of the user in the particular pose is determined to be included inthe images, the method further comprises: setting the display system toenter a try-on mode.
 7. The method according to claim 6, wherein whilethe display system is in the try-on mode, after the step of generatingthe first preview image, the method further comprises: setting thedisplay system to leave the try-on mode and displaying the first previewimage on the screen.
 8. The method according to claim 7, wherein whilethe display system is in the try-on mode, after the step of generatingthe first preview image, the method further comprises: capturing atleast one other first image of the user wearing the first apparel inother poses by using the image capturing device; and processing the atleast one other first image to generate at least one other first previewimage.
 9. The method according to claim 8, wherein after the step ofgenerating the first preview image and the at least one other firstpreview image, the method further comprises: storing the first previewimage and the at least one other first preview image in a database; andsetting the display system to leave the try-on mode and enter a lookbookmode.
 10. The method according to claim 9, wherein the database furthercomprises at least one preview image corresponding to at least one otherapparel, and wherein in response that the display system enters thelookbook mode, the method further comprises: detecting a selectionoperation performed by the user on a designated pose among a pluralityof poses; and displaying a plurality of designated preview imagescorresponding to the designated pose on the screen, wherein each of thedesignated preview images is associated with a processed image of theuser wearing a different apparel in the same designated pose.
 11. Themethod according to claim 1, wherein the step of segmenting theforeground region and the background region in the first imagecomprises: performing facial detection on the first image to define afacial region; defining a foreground segmented region in the first imageaccording to the facial region; obtaining a depth image corresponding tothe first image; performing binarization on the depth image toaccordingly generate a plurality of foreground depth pixels; definingand setting a plurality of foreground plane pixels corresponding to theforeground depth pixels in the foreground segmented region as theforeground region; and setting a region outside the foreground region inthe first image as the foreground region.
 12. The method according toclaim 11, wherein the step of defining the foreground segmented regionin the first image according to the facial region comprises: defining ahead region of the user according to the facial region; calculating aheight of the user according to the head region; and defining a boundaryof the foreground segmented region according to the facial region andthe height of the user.
 13. The method according to claim 11, whereinthe step of performing binarization on the depth image to accordinglygenerate the foreground depth pixels comprises: performing binarizationon the depth image to generate a plurality of foreground pixels; andperforming erosion, dilation, and blur processing on the foregroundpixels to generate the foreground depth pixels.
 14. The method accordingto claim 13, wherein the step of generating the foreground depth pixelsfurther comprises: setting a background depth pixel neighboring to andhaving a similar pixel value to the foreground depth pixels as one ofthe foreground depth pixels.
 15. The method according to claim 13,wherein the step of generating the foreground depth pixels furthercomprises: obtaining a distance range of the user with respect to theimage capturing device; obtaining a depth information rangecorresponding to the distance range according to a depth-distancerelationship table; and filtering out the foreground depth pixels withdepth information being greater than the depth information range. 16.The method according to claim 1, wherein the step of processing thebackground region to generate the processed background region comprises:performing blur processing on the background region to generate theprocessed background region.
 17. The method according to claim 1,wherein the step of processing the background region to generate theprocessed background region comprises: setting a preset background asthe processed background region.
 18. The method according to claim 1,wherein the step of processing the background region to generate theprocessed background region comprises: obtaining related information ofthe first apparel according to an identification code of the firstapparel and thereby obtaining a color shade of the first apparel;generating a corresponding background according to the color shade ofthe first apparel; setting the corresponding background as the processedbackground.
 19. A display system comprising: an image capturing device,configured to capture images; a screen, configured to display images,wherein a capturing direction of the image capturing device is the sameas a display direction of the screen; a data storage device, configuredto store data; and a processor, coupled to the image capturing device,the screen, and the data storage device, and configured to: capture aplurality of images of a user wearing a first apparel appearing in frontof the screen continuously or intermittently by using the imagecapturing device; in response that a first image of the user in aparticular pose is determined to be included in the images of the userwearing the first apparel, shoot the first image by using the imagecapturing device; segment a foreground region and a background region inthe first image, and process the background region to generate aprocessed background region; and generate a first preview imageaccording to the foreground region and the processed background region,and display the preview image on the screen.
 20. A non-transitorycomputer-readable recording medium, recording computer programs to beloaded and executed by a processor of a display system having an imagecapturing device and a screen to perform steps of: capturing a pluralityof images of a user wearing a first apparel appearing in front of thescreen continuously or intermittently by using the image capturingdevice; in response that a first image of the user in a particular poseis determined to be included in the images, shooting the first image byusing the image capturing device; segmenting a foreground region and abackground region in the first image, and processing the backgroundregion to generate a processed background region; and generating a firstpreview image according to the foreground region and the processedbackground region, and displaying the preview image on the screen.